Purpose

Scrapes the professors for a section. Because the Banner API removed this field from the search results when not authenticated through Northeastern SSO, this has to be acquired via a separate request to the section professor details page.

Tickets

• Closes Teaching faculty for classes not being scrapped #238

Feature List

• When scraping sections, fires an additional request to the section's professor details page to get the faculty information.

Notes

This is kinda thrown together and the implementation very much can be improved. For now, it gets the job done but the scraper needs some love... I think there is code in there that is tested but never used?

Reviewers

Primary:
@ananyaspatil

Secondary:
@nickpfeiffer05 @Anzhuo-W @cherman23

UPDATE: As troubleshooting the OpenSSL error, the Yarn Berry PR #241 was merged into this PR. For documentation, the PR comment has been reproduced below.

Purpose

Migrates off of the end-of-life Yarn Classic to the actively maintained Yarn Berry version. In general, it is a drop in replacement, using the Node experimental Corepack as the preferred installation / management tool (the irony of managing a package manager).

Tickets

Closes #225, Closes #232

Feature List

• Switches from Yarn Classic to Yarn Berry in node_modules compatibility mode.
• Updates the Dockerfile to enable Corepack and use the same version of Yarn as dev, ensuring consistency.
• Prepped Dockerfile for a better build system in the future. Yarn Berry forces us to stop abusing Yarn like we were before so some of this needed to happen now anyway. This will be something that will show its value soon...
• Updates the GH actions to use Corepack to install deps (and generally get them to newer versions).

Notes

I will open a PR on searchneu soon to ensure that there is a version locked in because Corepack likes to add itself otherwise.